Algorithms for Initialization of Neural Network Weights
نویسندگان
چکیده
The paper is devoted to the comparison of different approaches to initialization of neural network weights. Most algorithms based on various levels of modification of random weight initialization are used for the multilayer artificial neural networks. Proposed methods were verified for simulated signals at first and then used for modelling of real data of gas consumption in the Czech Republic.
منابع مشابه
Neural Network Sensitivity to Inputs and Weights and its Application to Functional Identification of Robotics Manipulators
Neural networks are applied to the system identification problems using adaptive algorithms for either parameter or functional estimation of dynamic systems. In this paper the neural networks' sensitivity to input values and connections' weights, is studied. The Reduction-Sigmoid-Amplification (RSA) neurons are introduced and four different models of neural network architecture are proposed and...
متن کاملA Bayesian approach for initialization of weights in backpropagation neural net with application to character recognition
Convergence rate of training algorithms for neural networks is heavily affected by initialization of weights. In this paper, an original algorithm for initialization of weights in backpropagation neural net is presented with application to character recognition. The initialization method is mainly based on a customization of the Kalman filter, translating it into Bayesian statistics terms. A me...
متن کاملPrediction of Surface Roughness by Hybrid Artificial Neural Network and Evolutionary Algorithms in End Milling
Machining processes such as end milling are the main steps of production which have major effect on the quality and cost of products. Surface roughness is one of the considerable factors that production managers tend to implement in their decisions. In this study, an artificial neural network is proposed to minimize the surface roughness by tuning the conditions of machining process such as cut...
متن کاملForward Selection Initialization Method for Constructive Neural Networks
In this paper we present an initialization method of hidden unit weights for cascade-correlation type constructive neural networks. The forward selection initialization (FSI) method uses a large pool of randomly initialized hidden units and then selects the best one of them by some predetermined criterion which in our simulations was the objective function used in the hidden unit training. The ...
متن کاملEarly Prediction of Gestational Diabetes Using Decision Tree and Artificial Neural Network Algorithms
Introduction: Gestational diabetes is associated with many short-term and long-term complications in mothers and newborns; hence, the detection of its risk factors can contribute to the timely diagnosis and prevention of relevant complications. The present study aimed to design and compare Gestational diabetes mellitus (GDM) prediction models using artificial intelligence algorithms. Materials ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004